Methods for presenting and determining the efficacy of progressive pictorial and motion-based CAPTCHAs

ABSTRACT

Methods for presenting and determining the efficacy of progressive pictorial and motion-based CAPTCHAs are disclosed. The CAPTCHA system uses images, pictures, and/or motion for granting access to a computing system. The images can be culled from examples used in pictorial games, and can progressively presented to increase the strength of the CAPTCHA challenges. Speech recognition, motion and touch sensing can also be employed as parts of the challenge. When a CAPTCHA is presented, the methods may include steps of measuring efficacy by determining a percentage of users who are able to solve the CAPTCHA correctly within a defined period of time.

RELATED APPLICATION DATA

The present application claims the benefit under 35 U.S.C. 119(e) of thepriority date of Provisional Application Ser. No. 61/076,495 filed Jun.27, 2008 which is hereby incorporated by reference. The application isfurther related to the following applications, all of which are filed onthis same date and incorporated by reference herein:

-   -   Pictorial Game System & Method; Ser. No. 12/494,013    -   Internet Based Pictorial Game System & Method; Ser. No.        12/494,065

FIELD OF THE INVENTION

The present invention relates to challenge systems which includepictorial and/or motion features.

BACKGROUND

A popular board game introduced many years ago goes by the name ofPictionary™. In this game teams of players compete against each other byhaving one member of the team manually draw an object (which could be aperson, place, thing, action, etc.) while the other members of the teamattempt to guess the identity of the object. A time factor is alsoaccounted for in that the team must determine the object within acertain time period.

Pictionary™ is one form of pictorial game that has enjoyed great successin the market, but it has not been rendered into a form suitable forInternet accessibility. One example of a drawing game that has beenimplemented in electronic form is depicted in US Publication No.2007/0018393, incorporated by reference herein. It is apparent thatthere is a need for other similar types of games with different rules,objectives that can be enjoyed in electronic form, and particularly onsites available on the Internet (including social network sites) andother hand held devices (including advanced phones).

CAPTCHAs (Completely Automatic Public Turing Tests To Tell Humans AndComputers Apart) are well-known for controlling access to computers andresources on the Internet. A recent example by Sanghavi et al. (USPublication No. 2009/0113294) incorporated by reference hereindemonstrates the use of a progressive CAPTCHA. The use of a progressivetechnique increases the cost to spammers seeking to use human capital tocircumvent text based CAPTCHAs. While Sanghavi et al propose theirapproach for conventional (distorted) text type challenges, they fail toappreciate the potential for image based challenges. In particular,recognition of images can be incorporated as part of a picture basedgame to develop appropriate challenges, unlike text approaches.

SUMMARY OF THE INVENTION

An object of the present invention, therefore, is to reduce and/orovercome the aforementioned limitations of the prior art.

A first aspect of the invention concerns a method of conducting apictorial based electronic game comprising the steps: presenting anelectronic image authored by a human composer within a graphicalinterface; wherein the electronic image is presented in a visualsequence that substantially tracks a rendering of such image asperformed by such human composer; associating the electronic image withone or more concepts; providing a rule set for a user to use to predictan identity of the one or more concepts; processing responses from theuser in compliance with the rule set to determine if the user hasaccurately determined an identity of the one or more concepts associatedwith the image; wherein the electronic image is presented to the userduring at least a portion of the visual sequence substantially withoutexplicit textual information describing the one or more respectiveconcepts.

The electronic image can be presented on a user's television system, abrowser, a portable computing device such as a PDA, cell phone, etc. Theimages can be created automatically or by human composers with an onlinegraphical composition tool. In some embodiments the responses from theuser are tabulated to compute a performance of the user, the electronicimage, and an artist associated with the electronic image.

Some embodiments may also provide one or more audiovisual cues and/orclues to the user to assist in decoding the electronic image. Anelectronic advertisement can be provided as part of the one moreaudiovisual cues and/or clues. The audiovisual cues and/or clues can bederived from images associated with a second set of conceptssemantically related to the one or more concepts.

For some applications the electronic image is presented at differenttime intervals with differing levels of resolution, noise and/orpixelation.

In other applications the responses are provided as speech utterancesand recognized by a speech recognition engine. The speech recognitionengine can be configured to listen to multiple users simultaneously todetermine a winner.

A graphical tool can be provided to permit the user to create a secondelectronic image to be decoded by a second user. Users can also availthemselves of a file uploading tool in some cases for permitting theuser to upload a photographic file image to be decoded by a second user.

The invention also supports team play for some embodiments. Differentteams can compete against each other, even from at different physicallocations. In team play the teams can influence an identity and/or acomposition of the electronic image during a competition.

In some embodiments the ability to repeat the game for a plurality ofsecond electronic images constituting a benchmark set is allowed, sothat the user's responses are measured against other users to determinea performance rating relative to the benchmark set. A recommendationengine can be used to recommend at least one of an artist or a secondelectronic image to the user based on the responses.

Still further embodiments derive the electronic image automaticallybased on a content of an Internet page. In some portable applications aseries of different electronic images are presented in response to achange in orientation of a portable device which is presenting theimages.

Another aspect of the invention concerns conducting a pictorial basedelectronic game comprising the steps: presenting an electronic imagewithin a graphical interface, the electronic image being derived from ascene captured by a machine and embodied in a digital and/orphotographic form; wherein the electronic image is presented in a visualsequence that varies so that content is gradually revealed for the imageover a first time period; associating the electronic image with one ormore concepts; providing a rule set for a user to use to predict anidentity of the one or more concepts; processing responses from the userin compliance with the rule set to determine if the user has accuratelydetermined an identity of the one or more concepts associated with theimage; wherein the electronic image is presented to the user during atleast a portion of the first time period substantially without textualinformation describing the one or more respective concepts.

An additional step can be performed to combine the digital and/orphotographic form with other metadata for the scene in to the electronicimage. A computing system can be trained and employed to automaticallyfind digital and/or photographic form images in one or more Internetaccessible image repositories. The electronic images can include scenecomponent, scene timing information and device orientation for the sceneas part of the electronic image. Advertising information for the scenecan also be incorporated as part of the electronic image.

Still another aspect concerns conducting a pictorial based electronicgame comprising the steps: presenting an electronic image within agraphical interface, the electronic image being derived from a scenecaptured by a machine and embodied in a digital and/or photographicform; wherein the electronic image is presented in a visual sequencethat varies so that content is gradually revealed for the image over afirst time period; associating the electronic image with one or moreconcepts; providing a rule set for a user to use to predict an identityof the one or more concepts; processing responses from the user incompliance with the rule set to determine if the user has accuratelydetermined an identity of the one or more concepts associated with theimage; wherein the electronic image is presented to the user during atleast a portion of the first time period substantially without textualinformation describing the one or more respective concepts.

Another aspect of the invention concerns operating an Internet basedpictorial game with a computing system comprising: providing a databaseof game images related to associated topics, the game images beinggenerated by human composers; associating the electronic image with oneor more concepts; providing a rule set for a user to use to give aprediction of an identity of the one or more concepts; presenting thegame image with the computing system in a visual sequence thatsubstantially tracks a rendering of such image as performed by suchhuman composer; automatically processing responses from the user incompliance with the rule set with the computing system to determine ifthe user has accurately determined an identity of the one or moreconcepts associated with the image; wherein the electronic image ispresented to the user substantially without explicit textual informationdescribing the one or more respective concepts.

The game image is preferably presented within a web page loaded in anInternet browser, and can be part of a game website, and/or integratedas part of a personal profile page on a social networking site.

As with the other approaches users can participate as a team or incompetition against each other in providing the predictions. Theirscores can be based on a time required to give an accurate predictionfor the image. Additional visual clues semantically related to therespective concepts can be presented simultaneously to the user with thegame images.

Advertisements can be matched to the game images based on a plurality ofbids provided in an auction by multiple advertisers. The ads can bematched to artists based on a plurality of bids provided in an auctionby multiple advertisers for artists composing the game images.

Still another aspect concerns operating an Internet based pictorial gamewith a computing system comprising: providing a database of game imagesrelated to associated topics; associating the game image with one ormore concepts; providing a rule set for a user to use to give aprediction of an identity of the one or more concepts; presenting thegame image with the computing system in a visual sequence that varies sothat content is gradually revealed for the image over a first timeperiod; automatically processing responses from the user in compliancewith the rule set with the computing system to determine if the user hasaccurately determined an identity of the one or more concepts associatedwith the image; wherein the electronic image is presented to the userduring at least a portion of the first time period substantially withoutexplicit textual information describing the one or more respectiveconcepts. The game image is preferably revealed in a spatially randomsequence.

A further aspect concerns operating an Internet based pictorial game ona social networking site with a computing system comprising: providing adatabase of game images related to associated topics; associating theelectronic image with one or more concepts; wherein the game images arecontributed by members of the social networking site; presenting thegame image with the computing system within a social networking sitepage in a visual sequence that varies so that content is graduallyrevealed for the image over a first time period; wherein the electronicimage is presented to the user during at least a portion of the firsttime period substantially without explicit textual informationdescribing the one or more respective concepts; automatically processingresponses from the user with the computing system to determine if theuser has accurately determined an identity of the one or more conceptsassociated with the image; selectively publishing results of the user'sperformance on the social networking site. In some embodiments multiplemembers of the social networking site can play the game in acollaborative mode.

Yet another aspect is directed to a pictorial based electronic game thatincludes one or more software modules implemented in a computer readablemedium to effectuate the above aspects.

Another aspect concerns a method of testing recognition of images for aCAPTCHA (Completely Automatic Public Turing Tests To Tell Humans AndComputers Apart) system comprising: automatically electing an electronicimage for a participant with a computing system, wherein the electronicimage comprises imagery other than words; associating the electronicimage with one or more concepts; progressively revealing informationover a first time period for the electronic image within an interfacefor the participant using the computing system; automatically processingresponses from the participant with the computing system to correlate anaccuracy of guesses from the participant for the one or more conceptsassociated with the electronic image.

Preferred embodiments use a step of calculating a percentage ofparticipants able to decode and accurately guess the one or moreconcepts within a predetermined time. The electronic image can bepresented at different time intervals with differing levels ofresolution, noise and/or pixelation. The electronic images can then berandomly selected as needed within a CAPTCHA system for granting accessto resources of a second computing system, including a portableelectronics device.

A further aspect concerns providing a visual CAPTCHA (CompletelyAutomatic Public Turing Tests To Tell Humans And Computers Apart)challenge comprising: automatically electing an electronic image for aparticipant with a computing system, wherein the electronic imagecomprises imagery other than words; associating the electronic imagewith one or more concepts; progressively revealing information over afirst time period for the electronic image within an interface for theparticipant using the computing system; automatically processingresponses from the participant with the computing system to detect if aguess from the participant for the one or more concepts associated withthe electronic image meets a required threshold.

In some embodiments the responses are received in audible form andprocessed by a speech recognition device adapted to recognize humanvoices. The visual CAPTCHA challenge can be combined with a physicalCAPTCHA challenge requiring the user to manipulate the portablecomputing device in a prescribed manner. The physical CAPTCHA challengecan also interact with elements of the electronic image and/or otherobjects presented in the interface.

Another aspect is directed to providing a motion and/or orientationbased CAPTCHA (Completely Automatic Public Turing Tests To Tell HumansAnd Computers Apart) challenge on a portable computing devicecomprising: automatically electing a manipulation challenge for a userwith the portable computing device, wherein the manipulation challengeincludes a set of physical manipulation instructions for the portablecomputing device for the user; automatically processing sensory dataassociated with user movements and/or manipulations of the portablecomputing device; automatically determining if the user movements and/ormanipulations from the user meet a required threshold for satisfying theset of manipulation instructions.

The set of physical manipulation instructions for the motion and/ororientation based CAPTCHA challenge can be presented in an electronicimage, and/or in audible form by a text to speech engine operating onthe portable computing device. The set of physical manipulationinstructions typically require the user to move the portable computingdevice so as to manipulate objects presented in an interface. Forexample, the set of physical manipulation instructions may require theuser to orient a needle of a virtual compass in a specified direction,or explain (in spoken form) what direction the needle is pointing to atany moment in time. Alternatively the physical manipulation instructionscan require the user to speak or blow into a microphone.

Still another aspect concerns providing a touch based CAPTCHA(Completely Automatic Public Turing Tests To Tell Humans And ComputersApart) challenge on a portable computing device comprising:automatically electing a manipulation challenge for a user with theportable computing device, wherein the manipulation challenge includes aset of physical touch instructions for the portable computing device forthe user; automatically processing touch sensory data associated withuser movements and/or manipulations of objects within a graphicalinterface of the portable computing device; automatically determining ifthe user touch sensory data meets a required threshold for satisfyingthe set of physical touch instructions.

In some embodiments the set of physical touch instructions for themotion and/or orientation based CAPTCHA challenge are presented in anelectronic image, and/or in audible form by a text to speech engineoperating on the portable computing device. The instructions may requirethe user to arrange a set of letters on the graphical interface, ororient an object in a proper direction.

A further aspect concerns the fact that the various CAPTCHA challengesare embodied in a computer readable form and implemented as one or moreroutines executing on a portable computing device which also has motion,orientation, touch and/or microphone sensors.

DESCRIPTION OF THE DRAWINGS

FIG. 1 is an illustration of a first embodiment of a pictorial gameimplemented on a stand alone computer or console;

FIG. 2 is an illustration of a second embodiment of a pictorial gameimplemented on an Internet website;

FIG. 3A illustrates a preferred embodiment of a pictorial game imagebuilder;

FIG. 3B illustrates a preferred embodiment of a pictorial game imagepresentation engine;

FIG. 3C illustrates a preferred embodiment of a pictorial gametabulating module;

FIG. 3D illustrates a preferred embodiment of a pictorial gamesynthesis-suggestion module;

FIG. 3E illustrates a preferred embodiment of a pictorial game speechrecognition module;

FIG. 3F illustrates a preferred embodiment of a pictorial gameadvertising module;

FIGS. 3G, 3H and 3J show examples of user contributed content that canbe artistically styled and formatted for embodiments of the presentinvention;

FIG. 4 depicts a preferred embodiment of a pictorial game website;

FIG. 5 illustrates a preferred embodiment of a pictorial game teamrating module;

FIG. 6 illustrates a preferred embodiment of a variant of a rule setused in a pictorial game;

FIG. 7 depicts a preferred embodiment of a game screen used in apictorial game;

FIG. 8 depicts a process for integrating advertisements and epicts inaccordance with the present invention.

DETAILED DESCRIPTION

FIG. 1 is an illustration of a first embodiment of an electronicpictorial game 100 implemented on a stand alone computer or console. Inthis embodiment an input device 110, which may be an electronic tablet,pad, or equivalent canvass is used by a human artist to createelectronic pictures, generally referenced herein as “epicts.” Again, asnoted above, the epicts may represent human authored viewable renditionsof human perceivable concepts, which, in the broadest sense may be inthe form of ideas, people, places, things, actions, emotions, etc. Inother cases the epicts may be conventional electronic photographicimages which have been formatted to be compatible with an accompanyingpresentation system.

A stylus 115 is preferably used to aid with such process, and is adaptedfor human manipulation such as in the form of a hand held pen. Othertypes of manipulable tools can also be used of course depending on theparticular game and desired manipulation (eye, head, foot, etc.)required to provide input.

The epict is displayed for viewing by the artist and other gameparticipants on a display 120 which may be coupled to or part of acomputing device with a software/hardware engine adapted for renderingthe image in appropriate form. Thus the display may be part of atelevision, a computer monitor, etc., and the accompanying computingdevice may be a personal computer, a game console or other similardevice.

Data is communicated to and from the input device 110 through acommunications channel 125 which is preferably a wireless link. In someembodiment it may be desirable to provide feedback to the artist in theform of game rules, suggestions, etc. to the tablet for consideration.The image data can be transferred over the channel in any desired form.

Other variations of such architecture are of course possible, such asthe use of multiple tablets/pads 110 (and accompanying stylus devices115) to allow for multi-player simultaneous play. In such instances itmay be useful to divide display 120 into distinct regions and partitionsfor displaying the various artistic renditions. For example, with 4artists the display could be divided into 4 quadrants, which would allowparticipants to view 4 simultaneous renditions of an object.

In other embodiments a handheld pointer 130 may be used to draw directlyon the screen display 120. The pointer may be of the type used in theWii gaming platform which is a well-known system for this type ofinteractivity. For some embodiments it may be possible to use anelectronic PDA or cellphone that is synced to the gaming console 120 toprovide the epicts.

In its most basic form the pictorial game 100 can be configured to use aset of rules and scoring options that imitates the functionality of thePictionary game noted earlier. For example the participants could berequired to rotate the artist function, the participants could berequired to move a visible token across a virtual playboard projected ondisplay 120, the participants required to guess the concept in aparticular time period, etc. In this version of the game, theparticipants play on teams which compete against each other to guesswhat concept is being drawn by a co-team member. The concepts may besupplied by the game engine 120, or may be supplied by a remote server145. It would be relative easy for these functions to be implementedelectronically and this option may be attractive to persons who likesuch game and want to duplicate the experience in enhanced form with anelectronic platform. Nonetheless a variety of additional or modifiedrules and options for drawing, scoring, guessing, etc., could be electeddepending on the desired game format, and such features could be adoptedon a game by game basis by the game host and participants.

As an example of such modified rules, the game could be run withoutrequiring players/participants to provide responses or guesses. In onesuch case artists could contribute their epicts in connection with anongoing event that they are attending (e.g., a concert, sporting event,trade show and the like), viewing (as in a television broadcast orgaming experience seen on receiver 147) or hearing. The epicts could bedirected to different topics and aspects of the vent, and could formpart of a collective artistic gallery that is presented to a largeraudience of the event simply for viewing and entertainment. Again, theorganizers of such event could use human or machine editors to solicitand select particular ones of the epicts that appear superior to others.For example at a sports stadium/arena a fan's live artistic contributioncould be displayed on the scoreboard and the like.

In other embodiments the invention could be used at various events tosolicit and encourage crowd and audience participation. For example, ata music concert, attendees could be given a chance to enter theirsketches of the events occurring at the concert, such as the make up ofthe band, caricatures of the band members, etc. These sketch submissionscould be uploaded and viewed by event managers to identify and selectparticular sketches for recognition. The recognition in turn couldconsist of financial or non-monetary incentives for the contributor. Inother instances fan contributions could be displayed and vieweddynamically (along with attribution to the fan by name, seat number,etc.) as they are created for further enjoyment. This same format couldbe used at sporting events and other large public gatherings where itwould be desirable to report graphical data in real-time for publicconsumption.

For some games it may be desirable for the participants to upload thegame data to an offsite location for storage, review, etc., using a datafeed 140. The epicts, concepts and participant information could thus beintegrated into the feed 140 which can be incorporated within a socialnetwork site page or broadcast to other authorized friends and thirdparties. For example many social networking sites now include specificareas for allowing user contributions to be added dynamically to apersonalized page.

Similarly the epicts may be compiled by concept, topic, etc. by a remoteserver 145 for presentation to other network users. The remote servermay be programmed with additional game reward logic to give prizes,recognition, etc. to participants and teams in real-time to facilitateand increase game interest. If desired, the entire game could bejournalled and replayed (at higher speeds as well) at a later time forviewing.

It will be understood by those skilled in the art that other featurescould be implemented into the present embodiment to add to theinterest/excitement of the game. For example, an express option toinclude musical cues could be added, so that the artist's rendition isaccompanied by a song or other audible clue that assists theparticipants to guess the concept in question.

To assist with this function automated music matching logic 150 could beused to coordinate the visual rendering of the epict with the musicchosen by the artist. For example if the artist took 30 seconds tosketch a picture of a bird, the music matching logic could be used toautomatically select and extract an equivalent (an relevant) 30 secondsof music (perhaps with lyrics masked to avoid explicit rendering of theanswer) from a song such as “Blackbird” by the Beatles to present withthe epict. The music excerpts can be obtained from any one of a numberof online sources, and may be further cropped as needed to accommodate aparticular epict. To make their incorporation easier, they can becatalogued by different topic tags, so that they can be identified andselected easily by a human artist. By keeping the music excerpts shortthe issues of copyright and fair use can be minimized.

As further explained, speech recognition (as described below in moredetail) could also be incorporated to recognize participant utterancesand assist with scoring.

A second embodiment of a pictorial game 200 implemented on an Internetwebsite is shown in FIG. 2. The components of this system generallyinclude a game module 210 which has access to a database of images 205for creating a set of epicts 215.

The images 205 can be derived from a number of sources, includingcommunity artists' contributions, pictures/graphical content contributedby members, and other image data automatically retrieved from onlineimage repositories (e.g. such as from the Google image search engine).In some embodiments the images could be linked from member's othersocial networking pages (e.g. Facebook, Myspace, etc.), onlinephotograph accounts (e.g., such as Flickr, Picassa). Details of suchcompilation are described below in connection with FIG. 3A.

Returning to FIG. 2, the game module 210 includes a number ofcomponents, including an image library 220, a tabulating module 230, apresentation engine 240, a synthesis/suggestion engine 260, and a speechrecognition module 270. An advertising module 280 can also beincorporated if needed. Each of these routines is preferably implementedas one or more software routines adapted for executing on an Internetaccessible server, and capable of interacting with input from clientbrowsers, back end databases, website pages and other similarprocessing/data resources.

The aforementioned routines are specifically responsible for supportingan Internet website page 250, which includes a number of features andfunctions for interacting with users of an online gaming site. Forexample the gaming page 250 could include a set of challengewords/epicts 290; a set of ratable epicts 294, and a community votingsection 296. Each of these is discussed briefly here and in more detailbelow in connection with FIG. 4.

In FIG. 2, the challenge words/epicts 290 represent a set of words—to bedrawn by contributing artists and a set of epicts—drawings to be guessedat by other participants. As seen below, selecting this feature allowsthe member to either invoke a drawing canvass/tool (to create an epictfor a specific word) or invoke an image presentation screen (to guesswhat word is appropriate for an epict concept). Both of these functionsare described in more detail below.

The ratable epicts 294 feature allows members to examine specificepict-concept pairings, and rate them on their artistic/creative merit.Thus, for example, this section of the site may be used to view specificartistic renditions of particular concepts. Members may be encouraged orrequested to contribute epicts on particular themes, subjects, objects,etc. The ratings are then captured and compiled for community perusaland other purposes described herein. A number of different datacollection schemes exist for this purpose and could be used for suchpurpose, including conventional polling software.

Furthermore the gaming page may include options and features forpresenting the various tabulations accumulated by the site for userentertainment. As an example, particular epicts, artists, concepts couldbe recognized, along with top N lists and the like.

It will be understood that all of the above applications (challengewords/epicts 290, ratable epicts 294, community voting 296) and otherscould also be implemented by members on an individual basis on theirrespective web pages. For example the feature could be implemented as aseparate application for inclusion within pages of a social networkingsite, in the same way that Facebook users can incorporate other games orfeatures on their profiles or data feeds. This would allow the conceptsof the present invention to be perceived and disseminated to a wideraudience.

As seen in FIG. 2, the epicts 215 are preferably stored according toconcept, artist, etc. to create a master community database ofaccessible image content. Each epict is preferably tagged with an artistname (if available), one or more concept (word) tags, and other datadescribed below.

The individual modules responsible for carrying out the main functionsof the invention are now described in more detail in connection withFIGS. 3A-3F.

A preferred embodiment of an image library builder module 320 shown inFIG. 3A includes a number of components for constructing a database ofepicts. As seen there candidate images 305 for epicts can be receivedeither through manual contributions or automatic selection from avariety of sources, including Internet collections, private collections,artist solicitations, artist submissions, etc. Candidate concepts 306can be similarly received manually (through member/community explicitcontributions) or through automatic collection/generation from onlineresources such as dictionary and encyclopedia references. In the lattercase, local/topical themes (regional events/happenings) or contemporarythemes (holidays, seasonal events) may be employed to augment a list ofconcepts for artists to consider. Other sources of such data will beapparent to those skilled in the art.

A library/content builder routine 321 retrieves and processes theseimage and concept/word contributions. The native image data 322 isexamined to see if it is compatible with a presentation engine(described below) format, and, if not, it undergoes further formattingtreatment by a routine 323 to convert it into acceptable form. A productcurrently offered by Studiomee titled “Pocket Artist” provides this typeof functionality, and other similar products could be used. The PocketArtist product and Pocket Sketch products are available from the iTunesapp store. A similar feature is offered by Sketchmyphoto also availablefrom their website.

For example in some embodiments of the invention an epict may consistnot of artistic drawings, but solely of an actual photographic image ofan object, such as a bird in a tree. The image file may be filtered andreduced (in terms of visual features) to render a simplified version ofthe image that can be broken down into discrete components. For exampleall the background elements of the image could be stripped out to showonly the bird itself. Then the image could be divided—logically orphysically—into distinct regions that are further reduced in complexity,so that, for example, only basic features and outline of the shape ofthe bird remain. These basic features thus make up and are then used tosynthesize the image in later renditions of the epict. Various forms ofconventional picture processing software are capable of this type ofoperation and could be used for this purpose. For example the AdobePhotoshop Elements software includes several image “filtering” features(for example the “poster edges” and “fresco” look found under theartistic category, and several aspects of the sketch category (photocopyfor example)) that provide this type of capability. The advantage ofsuch format is that it can take up less space and is somewhat moreconsistent in terms of giving the game an artistic look. An example ofan original JPEG photo and an artistically formatted counterpart isshown in FIG. 3G. Even in the black and white reduced version the imageis still recognizable.

Nonetheless it is possible to use simple JPEG (or similarly compresseddata formats) for visual images if desired. Again the precise format ofthe epicts will be a function of the specific design goals and isexpected to vary from application to application.

The images are also processed by an image supplementation module 325which is used generally to locate other associated and relevant contentfor the candidate image as part of the pictorial game. For examplemetadata routine 326 is adapted to identify/extract appropriate contenttags. The content tags represent correct responses or answers that maybe associated with the epict in question. For example a picture of a catmay be tagged with the descriptors “cat,” “pet” “purr” and so on. Insome cases such data may be explicitly provided, in others it may bedetermined by reference to various software tools available on themarket for identifying the nature of objects shown in an image.

A semantic supplementer routine 327 examines the tags/descriptors andother concepts and determines other semantically related concepts andwords. Thus for example, in the above example, the “pussycat” and“feline” may be determined (with reference to a reference semantic toolsuch as WORDNET) to be semantically related to “cat.” Based on suchassociation additional text tags could be appended by a routine 322′along with other native or processed supplemental image data associatedwith the content of such additional text tags. Thus, for example, ifimage data already exists for such semantic relatives, it can beassociated with the candidate epict in question for use in the game.

The completed epict is then stored in a primary image database 324,along with the other associated metadata/parameters noted above. Asecondary image database 324′ contains related images that can beaccessed/related as desired to the entries in the main database. Adatabase interface 328 is used to query and access epict content asneeded by other routines as described below.

A preferred embodiment of an epict record 329 is also shown in FIG. 3A.Each epict is preferably coded with the following parameters:

-   -   a unique image ID (a numerical designation of any appropriate        length);    -   an image name—(a listing of the appropriate content tags,        descriptors, etc.);    -   image components (some images may be stored in a format where        the artist's rendering of the image is journaled into distinct        components; in other cases the contributions can be        automatically rendered into components by formatting routine        323);    -   image component timing (in instances where multiple components        exist, timing information can be provided to indicate what        component should be drawn first, second, etc., and at what        speed);    -   related image components (as noted above, a pointer to other        secondary images in database 324′ that can be associated with        the epict);    -   Origin ID (a reference to an artist, data source or the like        from which the epict was derived)

The preferred approach uses a scheme in which the electronic image ispresented in a visual sequence that substantially tracks a predictedrendering of such used by a human composer. In other instances where thecontent is not based on a human artist, the image can be presentedvisually as the system predicts a human artist would render it, or in amanner that is logically related to the subject matter of the image.

Those skilled in the art will appreciate that other parameters can beincluded as well depending on the application and desired functionality.For example some epicts could be tagged with automatic metadata(geocoding, time, etc.) as desired, along with additional pointers toappropriate musical relatives (as noted above).

A preferred embodiment of the process used in a pictorial game imagepresentation engine 340 is depicted in FIG. 3B. As alluded to earlier,the present invention can be implemented in various forms. For example,in an automated mode, the epicts can be drawn from database 324 andpresented within a portion of an interface for a webpage to be reviewedand evaluated by individual members. The members preferably have theability to select (and/or subscribe to) the epicts by category or topic.The members could then participate in a solo-type interaction with thegame through these individual epicts. Individual members may elect forthe epicts to be presented on their respective profile pages as acustomizable widget in accordance with one or more programmed themes oftheir selection. For example a particular user may direct the epictengine to randomly select topics based on the news of the day, so as tocause the system to dynamically present epicts directed to such conceptson his/her site as such content develops over time.

In other applications nonetheless it may be desirable for members toparticipate in epict presentations/guessing in a team based mode. Insuch instances members may elect to join and sign up as a team inaccordance with a set of rules as shown at 341. Invitations and sign-upscan be implemented with any number of known tools. The rules may bebased on the particular game chosen so that for example teams may playdirectly against other teams, or in some cases, may simply competeagainst a reference set of epicts. Other formats are of course possible.The rules may further specify scoring and other game options shown belowas well.

The game is then initiated at step 342 for the participants in question.The participants may enter the game directly by reference to a game ID,an authorization token or similar mechanism known in the art. In oneembodiment the teams are expected to review/create a number of separateepicts on a rotating basis. That is, a first team would create a firstepict for a second team to guess within a certain time period, and viceversa. The game can consist of a plurality of rounds (again selectableby the participants) in which different epicts are provided to therespective teams. The game final scoring can be based on any desiredmechanism, such as by determining the most correct guesses made for aset of N epicts. Other rules and variations can be used as well.

In a preferred embodiment the game members can view the epicts on theirrespective client devices (which may be a PC, a cellphone, a PDA, a gameconsole, etc.) in accordance with image data/game formattingrequirements at step 343. As noted earlier the participant may also beshown additional supplemental images derived from a main epict to assistin guessing the concept in question. For some embodiments of the gamesthe teams can be presented epicts that come from a common librarydatabase 324, while in others the epicts are created during game time bythe participants themselves. Again other modes are contemplated by thepresent teachings and the participants can be given latitude to select aparticular rule set.

In those cases where game participants are required to create their ownepicts on the fly, a variety of different software tools can be used toassist them as needed to comply with a game selected concept that theyare asked to compose. These types of tools are again well-known in theart; one example is a software application known as Graffitti that isoffered on the Facebook site, and which presents a graphical interfacefor creating drawings for community review. See e.g.(h-t-t-p://)apps(dot)facebook(dot)com/graffitiwall/ andh-t-t-p://apps(dot)facebook(dot)com/graffiti/ An adaptation of thisproduct also allows replay/journaling features and this function couldbe incorporated as well with the present invention. Thus this product(or something equivalent) could be used both for creating and storingepicts for later use (as seen in FIG. 3A) or for permitting participantsto create content as required for a particular game. In the case ofusing “canned” epicts the individual replay components and timing couldbe stored as part of epict record 329 as noted above. For example theremay be variable parameters on how quickly the epict is drawn. That isthe ratio of how much drawing time is involved relative to a maximumtime allowed for recognition of the image can be adjusted based on adesired game difficulty. Another example of a drawing tool that may beappropriate for the present invention is described in US Publication No.2007/0016689 incorporated by reference herein.

On certain platforms, such as the iPhone, additional sensors could beexploited to render the image in different modes/styles. For example theiPhone contains motion sensors which can be used to determine theattitude of the device. The epicts could be encoded to have motion basedcomponents that are only expressed as the device is moved. For example,a picture of a tree could be coded so that it moves in response to thephone being moved. This could help denote the concept of “wind,” whichis otherwise difficult to conceptualize in a static drawing. A pictureof a hockey puck could be shown in different positions as the device ismoved, to denote the concept of sliding, and so on. A series ofdifferent images, representing scenes active at a differentorientation/rotation angle of the device, could be used to denote thepouring of water, such as from one container to another. The use of suchvariable position technique would be most advantageous in connectionwith concepts involving verbs, actions, etc. The possibilities areendless in this respect, and other examples will be apparent to thoseskilled in the art.

The artist participants may similarly be given clues/cues and otherforms of explicit assistance to help them create the pictorial images.The suggestions may be as simple as providing additional semantic wordcues that are perhaps easier to depict visually. Alternatively they maybe as complex as providing specific objects as templates to work from.For example for a dog the system may provide a basic body of an animalwith four appendages, allowing the user to construct the rest of theimage on his/her own. This technique can help solve the case of“drawing”/artist block for people who don't know what to use as astarting point.

As alluded to above, some embodiments may benefit from the inclusion ofmusical clues that are associated with the epict, and this feature canbe further used during the presentation to assist in decoding theimages.

At step 344 the responses are logged from the game participants (in theform of guesses, epicts, etc.) It will be apparent that in some casesthe raw ratings data feed to be tabulated for the game can originatefrom a standalone architecture (see data feed 140) as described in FIG.1 above. Moreover it should be apparent that the participants do nothave to be physically in the same location to participate as a team.

Again in FIG. 3A, the participant winners and associated prizes aredetermined at 345 by a decision software module using any desired set ofrules, i.e., such as by guessing the exact word (topic/concept) or asemantic variant as noted below. At 346 the game status/score for eachparticipant team is adjusted as well in accordance with the ruleselected for the game. The performance of theparticipants/teams/epicts/artists is then logged and tabulated at 347.This data can then be published as an update or feed if desired tosearch engines, profiles and other social networking sites.

The contributors of the content (artists, image sources, etc.) are thenrecognized at step 348 based on the use of the epict and/or a ratingprovided therefore. In embodiments of the game where some form ofaccounting is given to such entities a database can be maintained ofcredits or funds for each contributor.

As another option the presentation engine can use a collaborativefiltering or corroborative filtering routine to identify other epicts orartists that would be of interest to the game participants based ontheir rating or adoption of an epict/artist. In other words, the systemcan correlate epicts based on artist, content tag, score, etc., so thatparticipants can be shown other examples of epicts likely to be ofinterest based on their scoring for one or more game epicts. Similarlythe participants can be given information on other artists likely to beof interest based on scores given to a particular contributor by otherparticipants. This information could be compiled on a topic by topicbasis as well for further refinement. Recommendation routines arewell-known in the art and can be modified to accommodate any and all ofthe data types referenced above for the epict entries 329.

Again all of the feedback data above, including scoring can be used inthe architecture of FIG. 1 above as well.

The right hand side of FIG. 3B shows other game entry points for thepresentation engine 340 captured from a game site (or participant)webpage. For example image challenge selection logic 350 is responsiblefor selecting a particular epict to be used within a particular game orwidget. To make this determination it can examine collective communityratings for one or more epicts, consider contemporary/local topics, etc.to select one from database 324. In other embodiments the epicts couldbe rotated or randomized on a topic basis, an artist/source basis, etc.In still other applications the challenge selection logic 350 can makeuse of geospatial information to tailor the content of the challenges toa particular location where the user happens to be (in the case of aportable application). For example, in a baseball stadium the challengescould be geared to guessing the identity of players, and so on.

In some applications a CAPTCHA challenge system (not shown) couldintroduce visual content to be reviewed by humans to determine whatappropriate tags/concepts are presented for the image in question. Thisinformation can then be used to augment a library of challenge testimages. For example the challenge system could determine that an(intentionally visually distorted) image A is nonetheless identified aseither X or Y by 90% of the population, thus making is suitable forinclusion in a CAPTCHA system. The image could be re-presented atvarious times to different participants/Internet viewers—and withdifferent levels of degradation—until it is no longer recognized by acertain percentage of the population. This process could be repeatediteratively—with progressively degraded versions of the image—as neededto meet the CAPTCHA system's requirements. The recognition times couldalso be measured for each iteration. In this manner the presentinvention can act as a form of testing ground for these types ofchallenge systems.

An optimized set of image challenges could be presented on an iPhonelike device as part of a CAPTCHA to gain access to accounts, data,computing resources, etc. The user would be asked to provide theidentity of the image either through a keyboard, or, if desired, audiblyusing speech recognition. The latter affords an additional layer ofprotection against would-be fraudulent accesses.

In still another embodiment, a CAPTCHA challenge for an iPhone typeportable device (capable of motion/orientations sensing of the device)can be based on providing hints or clues to a user on how to move ororient such device. That is, the CAPTCHA could provide either text on adisplay, or audible instructions to the user on how to manipulate theportable device, such as rotating it to the right, to the left, in acomplete circle, picking it up and putting it down N times, shaking itin different directions, etc., etc. as part of a CAPTHCA challenge. Forexample the current version of the iPhone has a built-in compass; theuser could be asked to orient the needle to point to a particularlocation (N, NE, E, SE, S, SW, W, NW and so on.) In other instances theuser may be asked to move the device so as to cause some action in ascene, such as to make water pour from a cup, and so on. Thus themanipulation of objects within the screen can be done as needed in achallenge based on sensing the movement of the device.

In other cases the CAPTCHA can include a visible image indicating themovement to be imparted to the device, such as showing a person rotatingit 90 degrees, picking it up and down, moving it in a figure 8 pattern,etc. Again the image could be progressively revealed or degraded ifdesired. Skilled artisans will appreciate that there are many optionsfor the physical manipulations and the invention is not so limited.

The touchscreen on an iPhone like device could also be integrated intothe challenge so that the user is required to physically touch ormanipulate icons or other objects to achieve some result. For examplethe user could be asked to arrange a set of letters in a sequence tospell a particular word in a particular location on the screen.Alternatively the user could be asked to orient an object into itscorrect position by moving it with their fingers such as describedgenerally in the article “What's Up CAPTCHA? A CAPTCHA Based On ImageOrientation” by Gossweiler et al. (WWW 2009, Apr. 20-24, 2009, Madrid,Spain) incorporated by reference herein—or by moving the device. Thoseskilled in the art will appreciate that other physical manipulationscould be employed, including blowing into the phone's microphone (as isdone in some games), etc. The challenges could be used, as noted, foraccessing computing resources, accounts, etc., and even for applicationssuch as unlocking/accessing the portable device (i.e., like a secrethandshake).

Returning to FIG. 3H, an example of the types of degraded images isshown therein. The same image as FIG. 3G is shown with different degreesof pixelation, again using the basic operational tool available withAdobe Photoshop Elements. At one level of extreme pixelation (createdusing a variable colorhalftone filter feature) the image is notrecognizable; but at lower levels the image can easily be distinguishedas a bunkbed as in the original. Similar effects can be achieved usingfilters such as crystallize, mezzotint, mosaic (and several image noiseand threshold options) all of which can be experimented with usingroutine skill to devise samples which are recognizable by humans but(preferably) not machines. For example FIG. 3J shows an original JPEGimage that has been subjected to various levels of noise filtering,either through removing noise (at different pixel levels) or addition(at differing percentages). It can be seen that at some thresholds ahuman would have a difficult time perceiving the object in the image,but there are clearly levels at which the image is decipherable. Theimages therefore could be subjected to different levels ofpixelation/signal processing treatment on the fly, or they could bestored as successive original files in the different degraded forms forease of computation/presentation.

At step 351 the selected epict is presented on the game website (ormember widget) in accordance with a set of game rules applicable to suchsite. User ratings and responses are collected in a similar fashion atstep 344 as noted before for the team embodiment.

In this manner the presentation engine 340 can accommodate andincorporate content contributed by participants across a wide variety ofinput platforms and game environments. All of the aforementioned stepsin FIG. 3B can be implemented using one or more software routines usingordinary skill in the art based on the present teachings.

FIG. 3C illustrates a preferred embodiment of a pictorial gametabulating module 330. This module is generally responsible forcompiling data and scoring for the epicts, participants, teams, etc.,publishing results and accounting for results of epict games.

As seen in seen FIG. 3C, a routine assigns each pictorial game an ID 331to identify it uniquely for tracking purposes. For each game, a set ofepict IDs 333 and participant IDs 334 are maintained. The epict scoresand participant scores are further stored by a routine in respectivedatabases 332 and 332′.

A routine 335 also calculates epict and participant scores. The scoringcan be based on any number of criteria, such as in the case of an epict,the fact that it was recognized, the amount of time required, whatrating was given to it, and the mode of presentation used (static ordynamic replay). The participants can be scored in a similar fashion,such whether they successfully recognized an epict (by identifying oneor more correct concepts), the amount of time required by theparticipant to make the guess, what rating was given by the participantand the mode of presentation used (static or dynamic replay). These arebut examples of course, and other types of data could be collected asneeded.

A separate routine 336 also calculates author/source scores to be storedin an artist database 332″. This scoring can be based on the sameparameters described above, so that, for example, artists are rewardedbased on positive ratings given by participants.

The results from the pictorial games (whether they be home based, orbased on team games, or derived from Internet sites, widgets, etc.) arepublished as desired by a routine 337. The results may include otheraggregate calculations, including image difficulty rankings, imageratings, group image ratings, author ratings, participant ratings, teamscores, game scores and similar data. Again the results can be madeavailable to any of the platforms from which the game originates,including an online gaming site or social network profile, home basedconsole system, etc.

The format of the data records maintained in the databases is showngenerally in FIG. 3C as well. For example for an image database 332, anepict record 338 may include the following fields:

-   -   Image ID (as noted above)    -   Presentation mode (whether it was displayed statically or using        a slow motion replay)    -   % identified within time (number of participants who correctly        guessed the concept of the epict divided by total viewers)    -   Mean recognition time (RT) (the average and/or mean times for        recognizing the epict)    -   Standard deviation RT (basic statistical data based on        recognition times)    -   Ratings Score (average score across all participants)    -   Difficulty Rating (numerical rating given by participants to        indicate how hard it was to decipher the epict)    -   Demographic data (information about the participants)

Note that the above is an example of an aggregate record. In additionsome of the above fields (where applicable) may be compiled on anindividual basis, with each game/rating of the epict given a uniquerecord. Other fields could be maintained in such case within database332 or an associated database, for example the actual time may berecorded for each epict evaluation. The types of data collected couldinclude other parameters as well.

In addition for the participants, an aggregate record 338′ stored indatabase 332′ can include:

-   -   Participant ID (a numerical designation of any appropriate        length);    -   Images Perceived (which epicts were evaluated)    -   Images Recognized (which ones were successfully identified)    -   Mean Recognition Time (basic mathematical computation of times        required by participant to review epicts)    -   SD (RT) (as above)    -   Ratings Score (as above, on an epict basis)    -   Favorite Authors (list of artists by ID)    -   Image IDs authored (list of epicts contributed identified by        epict ID)

As above, note the data/fields are for an aggregate record. Some of theabove fields (where applicable) may be compiled on an individual basis,with each epict rated given a unique record by score, actual reviewtime, etc. and are maintained within database 332′ or an associateddatabase. The types of data collected could include other parameters aswell.

Finally, for the individual contributors/artists, the following type ofaggregate record 338″ could be maintained within database 332″:

-   -   Author ID (as above)    -   Image IDs (as above, indicating which epicts created by this        artist)    -   Average Images Recognition Score (compiled across all epicts)    -   Mean Recognition Time (across all epicts)    -   SD (RT) (across all epicts)    -   Author Score (an average rating provided by participants)    -   Working on image challenge (indicating what contest they are        working on)

As above, note the data/fields are for an aggregate record. Some of theabove fields (where applicable) may be compiled on an individual artistbasis, with each artist having a unique record by epict rated, so thatan actual epict score, review time, artist score etc. are maintainedwithin database 332″ or an associated database. The types of datacollected could include other parameters as well.

While not expressly shown, it should be noted that team scores/data canbe maintained as well in essentially the same fashion as for individualparticipant scores noted above. The data for such teams can be publishedas desired as well to appropriate authorized entities.

Again it should be noted that these data fields may be varied fromapplication to application. It may be desirable to compile averagesrather than means in some cases, and so on. The particular parameterswill vary depending on the desired functionality. All of the above datacan be published in appropriate form by routine 337 in any number ofdifferent locations, formats, etc., for participant enjoyment.

FIG. 3D illustrates a preferred embodiment of a pictorial gamesynthesis-suggestion module 360. This feature of the invention isresponsible for assisting game participant artists to compose epicts,and to facilitate presentation of so-called preformed/canned epicts toparticipants.

As seen in this figure, based on a game ID 331 a determination is madewhether the game is to be run in an automatic or manual mode. In theformer case image/epict IDs 332 are obtained automatically from adatabase 324, while in the latter case a manual mode 361 requires a gameparticipant to create the epicts in accordance with the details notedabove (see FIG. 3B).

In either event the game participants have the option at step 362 toelect a supplemental presentation. This feature, as noted above inconnection with FIG. 3A, allows for additional secondary images andother cues(from database 332′) to be retrieved at 364 and presented aspart of the reference epict at step 365. In a manual mode thisinformation can be hidden from the participants and shown only to theartist to assist the latter in formulating appropriate images. If thesupplemental option is not elected the image data is presented at 363 inaccordance with any component/timing information associated with theepict. It should be noted that the automatic mode noted here would bethe default option for any epict games/presentations made in connectionwith a website/web profile implementation since artists are typicallyassociated with team play.

In the event a manual mode is used at 361 for the game the artist cannonetheless invoke a suggestion option for the concept at 366. If theuser selects such feature the game play routes through the same stepsabove, except that in addition to the supplemental option features thedesignated artist is given specific suggestions on images that could bedrawn to communicate the concept in question. If the option is notchosen the image is simply presented in a normal picture mode at 367.

All of the aforementioned steps in FIG. 3D can be implemented using oneor more software routines using ordinary skill in the art based on thepresent teachings.

Next, FIG. 3E illustrates a preferred embodiment of a pictorial gamespeech recognition module that can be used in some embodiments of theinvention. While this module is depicted in the context of a pictorialgame it will be apparent to skilled artisans that it can be used inconnection with any number of online games.

As noted above in FIG. 3B, participants guessing on the concept embodiedin the epict typically provide input on such using a keyboard or mouse.Another option however is the use of speech data from the participants.This feature has the advantage of most duplicating the prior art gameexperiences and frees the participants from the task of being distractedwhile analyzing the image data. Other benefits are apparent as well,including the fact that the participant voice prints collected by themodule can be used for authentication and access verification as well.

The recognition module 370 executed two basic procedures: a set up mode375 and a game mode 380. In the first mode, a routine solicitsparticipant voice inputs at step 376. This can be done in anyconventional fashion, including by collecting test words/phrases,examining for prosody, and accounting for background noise attendant atthe participant's site. In situations where more than one participant ispresent at the client device for presenting guesses a “crowd” mode canbe employed. Furthermore depending on the processing resources availableto the participant they may elect to have the bulk of the speechrecognition performed by a remote server associated with the pictorialgame system. Other options will be apparent to those skilled in the art.

At step 377 a set of voice prints/templates are thus developed for eachof the individual team members—in the case of a solo game of course,only the user invoking the game need provide a template. If a number ofplayers are present at a particular location, it may be desirable toprovide some form of amplitude compensation/normalization to account fordifferent participant speaking volumes.

An optional step 378 can be used to confirm that the system isaccurately discriminating between individual participants. Eachparticipant would be permitted to speak a test phrase, for example, andthe system would indicate which person it believes gave the utterance.In the event the system needs further training the procedure could berepeated.

During a game mode 380, the speech recognition module receives metadatafor one or more epicts at step 381. This metadata includes a number ofcontent tags describing the object of the epict, and may include anumber of different semantically related words.

Based on these “answer” responses an appropriate grammar and/orcustomized acoustic model can be loaded for the speech recognizer atstep 382. At this point therefore the speech recognizer need not becapable of recognizing substantial numbers of words. In fact it needonly focus on a handful of words, and thus it can be substantiallyreduced in computationally complexity because it can ignore all otherinputs that do not match one of the appropriate answers.

During step 383 the SR module listens for answers input by the variousgame participants. In the case of team members distributed acrossmultiple locations the data input to the SR is thus received frommultiple sources. In such instances it may be desirable to allocate adedicated SR resource to each channel to improve performance. The SRmodule then recognizes and time-stamps each accurate recognition at step384 to give appropriate attribution to the first participant accuratelyguessing the epict concept.

Nonetheless even in “crowd” scenarios where the participants are at asingle location, recent advances have made it possible to makereasonable resolutions of individual speakers who are speakingsimultaneously. See e.g.h-t-t-p://technology(dot)newscientist(dot)com/article/dn14105-robot-asimo-can-understand-three-voices-at-once(dot)htmlincorporated by reference herein. By using a similarly configuredconsole or game platform with appropriately located microphones a SRmodule could distinguish between multiple human speakers articulatingtheir responses at the same time. Other known tracking techniques foridentifying the correct speaker can also be employed, such as by usingvideo and other input.

Upon receiving a correct response the routine would identify a winner atstep 385. This feature allows the participants to express their answersrapidly and in free form without the need for slower, more cumbersomedata entries. It is expected that this form of input would be far morepreferable in embodiments of the invention where individual playersdesired to play the game over a portable device, such as an Iphone orsimilar device that includes speech capability built in. In suchinstances the grammars/dictionaries can be downloaded directly to thedevice (since they need only pertain to the universe of words associatedwith the concepts) to allow untethered (non-network) play in situationswhere the recognizer functions can also reside on the portable device.

FIG. 3F illustrates a preferred embodiment of a process employed by apictorial game advertising module 390. This process basically can be anadaptation of a conventional keyword auction based algorithm such as thetype used by such entities as Google, Yahoo!, Microsoft, etc. In thisinstance, therefore advertisers are permitted to bid on a keyword ortopic basis at step 391. In the present invention the keywords/topicsare preferably based on the epicts and related metadata (concepts/wordsand semantic relatives) stored in databases 324, 324′ (FIG. 3A). Thusthe advertising stock 392 is preferably served on an epict by epictbasis at step 393. In this fashion a content based matching system canbe implemented between advertising stock and the content of the epicts.

Since it may be undesirable to serve ads which have content that maycommunicate (and thus spoil) the epict recognition process by players(since it may be related to the topics/concepts of the epict), it ispossible to switch off the serving of ads as noted at step 394 until theepict has been recognized or the recognition time has passed. This wouldavoid the problem of players being given hints as to the identity of theepict. Other techniques could be used.

At step 395 the ad is served based on the advertiser's stock 392. Itshould be noted that in some cases it may nonetheless be desirable toincorporate advertising while the epict is being drawn as a mechanismfor assisting the recognition process. In this embodiment, the ad is infact assisting the player to solve an aspect of the game, a featureunlike other advertising modules used in the art.

This concept could be further enhanced by integrating other usercontributed content directly into the ads. For example one mode of thegame, as noted above, involves a suggestion component intended to assistplayers determine epict concepts. An ad which directly incorporates anepict determined to be related to (or suggestive of) the epict inquestion could be used to present the suggestion explicitly on theparticipant's screen while they are playing the game.

This collaboration between advertisers and artists can be extended atstep 396 so that particular artists/epicts can be essentially“sponsored.” For example, as seen in FIG. 2 (epicts 294) and FIG. 4(epicts 440) the identity/stock of epicts chosen for presentation withinthe web pages can be determined by advertisers who match theiradvertising stock to one or more epicts that they want to be associatedwith. In this respect, therefore, the epicts effectively act as webassets (akin to a web page in an Adsense campaign) that advertisers canbid to be associated with. By allowing advertisers to bid on specificassets (instead of queries, or web page content) the invention providesanother angle for monetization of such assets and opportunities foradvertisers.

The advertisers could in some cases be allowed to introduce their ownproprietary/customized epict content as well (to the image library) toenhance the appearance of the game and increase their exposure. They mayalso contribute their own list of concepts, topics, etc. to be used aspart of the game. Combined with the dynamic serving of ads related to anepict the invention allows for advertising to be used as an integral anddynamic component of an interactive game.

FIG. 4 depicts a preferred embodiment of a pictorial game website 400that embodies aspects of the present invention. Specifically, thisfigure shows a an example of a main web page that would be seen byInternet users accessing a game site. It should be noted that manyconventional aspects of such types of pages have been omitted to makethe description of the invention clearer.

In particular, the game site offers users a chance to set up andinitiate a pictorial game with all the features and functions describedabove in connection with FIGS. 2 and 3A to 3E. To wit, differentportions of such page as presented within a client GUI interface includeselectable URLs which invoke routines to permit the user to:

-   -   Start a team game (option 410)—allows for a team to start a game        against another team using the procedures noted in FIGS. 3A-3E;    -   Start a solitaire challenge (option 411) allows for an        individual to start a game using the procedures noted in FIGS.        3A-3E;    -   Submit a challenge word (option 412)—used for allowing members        to offer concepts/words to be expressed pictorially by other        members;    -   Watch a game (option 415)—allows a member to act as a form of        voyeur and observe a team game by topic, locale, team name,        etc.;    -   Upload an epict (option 420)—allows a user to submit their own        pictorial content and descriptor tags for the entertainment of        the community;    -   View top N lists for the community/site (option 425)—allows        users to see the highest rated epicts, the most difficult        epicts, team ratings, artist ratings, participant ratings, game        scores, etc.; the difficulty of epicts can be determined by        computing a total number of times the epict has been presented        versus how many time it has been recognized; artist ratings can        be similarly computed; the most difficult concepts to recognize        (either individually or by topic) can also be compiled    -   Enroll a team (option 430)—allows a user to set up a new team        for play on the site;    -   Find teammates (option 431)—allows user to find other persons to        be part of a team;    -   Find/rate an artist (option 432)—allows a user to search for        specific artists by name, topic, concepts, etc. and rate them if        desired    -   Search/Rate epicts (option 433)—allows a user to search for        specific epicts by artist, topic, concepts, etc. and rate them        if desired    -   Review/guess on challenge epicts (option 440)—allows users to        pick specific epicts/words to evaluate and play with in        accordance with game rules.        Again not all of these options are necessary, and other options        could be presented and offered as well, and the particular        implementation will vary according to game specifications and        requirements.

Some embodiments of the pictorial game can include a rating module 500as seen in FIG. 5. The purpose of this module is to allow teams 510 andindividuals 515 to access and play with a set of benchmark epicts (S1,S2, . . . Sn) 520 and evaluate their performance relative to suchstandard for competitive purposes. The benchmark epict sets can beselected by human editors, or automatically by rating module 500 byevaluating ratings/performances of epicts compiled by tabulating module230.

In the former case, a human editor may select a number (X) of epictsfrom database 324 based on a ratings list of X different topics. In thelatter case the identity of the individual epicts within the sets isdetermined by reference to some threshold rating for score, difficulty,etc. In either scenario the epicts are preferably selected to exposeparticipants to a cross section of the available inventory.

The participants then work through one or more of the epict sets (e.g.S1) and then have their times/accuracy evaluated by a routine 530 suchas that described above for FIG. 3A. Their scores, and the ratings (ifprovided) for the epicts are then compiled by a routine 540 that, againcan be similar to that already discussed above.

This aspect of the invention therefore allows members (and teams) toevaluate themselves relative to some test benchmarks for competitiverecognition. The results can be published, as noted earlier, for theentertainment of the overall community, to individual profiles, the maingame webpage, or other social networking sites.

FIG. 6 illustrates a preferred embodiment of a variant of a rule set 600used in a pictorial game. Basically this figure describes a format thatcan be employed in some variants of the game to make it more interestingfor some participants in team play applications.

In this embodiment a challenge word/concept is selected for a first team(A) by a routine at 610. This may be done randomly, by topic, or byanother rule choice opted by the members.

At 615, and without letting the member of team A see such word, themembers of team B are allowed to visualize various epict alternativesselected by the system for presenting such concept. The alternatives maybe selected randomly, or, alternatively, may be selected based on avariety of scores/ratings for such epicts. The latter may be used, forexample, to provide a reasonable cross section of challenges rangingfrom easy to difficult.

The members of team B can then (optionally) vote to eliminate (orselect) one or more of the alternatives to be used by the system forteam A at step 620. In some variants of the games the team members maybe allowed to see the difficulty ratings of the epicts as measured bythe performance of other individuals/teams.

During step 625 the final epict is then selected for team A based on theselection made by team B. In some cases it may be desirable toincorporate a randomizer at 630 to select in situations where theselection is not specifically defined.

At 635 the module further allows an option that gives team B yet anotheropportunity to impair or handicap team A's chances of success indecoding the epict. In particular the routine arbitrarily selectsaspects/components of the image which can be selectively removed fromthe epic to make it more difficult to decipher. Thus team B is againpresented with degraded variants of the epict to be shown to A, and theythen make a final selection which is presented at step 640.

As an ancillary feature the teams (or individuals for that matter) canmake use of a prediction component 650 which allows for review of epictsand their associated concepts to provide a prediction or vote as towhether such epict was recognized by some (system definable) percentageof the community, and/or a prediction of what rating such epictgarnered. For example the module may ask the participant a simple yes orno question about whether the epict was recognized within the allottedtime by more than 50% of the population? (or more than 75%, etc.) Themodule can then further request the participant's estimate of the ratinggiven by the community to the epict. The participants can then see howclose or far off their predictions are for the epict in question. Thisaspect of the invention therefore further allows participants to gleaninsights into the collective thinking of their fellow gamers.

These rule variants are not necessary of course, but provide anadditional element of play that may be attractive to some participants.Other examples of such variants will be apparent to skilled artisansfrom the present teachings.

FIG. 7 depicts a preferred embodiment of a game screen/interface 700used by a participant in a pictorial game. This screen may be part of aninterface that is presented within a conventional browser (or similarInternet browsing utility for a handheld device or game console) tointeract with game websites. This same interface may be used as well, asnoted above, in connection with user profile pages and the likemaintained at social networking sites.

Within the interface the participant is shown an electronic canvass 705in which the epict is presented visually. Again, the epict may be shownall at once, or it may be staggered as noted earlier. The canvass ispreferably scaled in size so as to allow participants to visualize theimage without noticeable compression, artifacts, etc.

At portion 710 the user is allowed to enter his/her guess of the object,by keying in an answer, selecting an answer by mouse, or speaking (inthe case of a speech recognition embodiment). Other forms of input couldbe used as well (touch for example).

Section 715 of the interface informs the user of his/her progress in thegame. For example the game may consist of a set number of epicts thatmust be completed to satisfy a game objective, and a time factor may beintroduced as well. The participants' score is also displayed at 716.

A time remaining for guessing the epict is shown at 717 in anyconvenient visual form (digital, analog, hourglass, etc.) and inaccordance with user preferences for the interface. In fact, preferablyall elements of the interface can be scaled, arranged and formatted inaccordance with a desired aesthetic of the user and to give a sense ofcustomization.

The category selected by the user is identified at region 718 of theinterface.

At portion 719 of the interface the game may display the answer if theuser has selected it correctly (a semantic equivalent may beacceptable). In some instances it may be desirable to “recognize”partial correction portions of a user's answer, so that if he/she inputs“cruise liner” the invention would nonetheless accept and display the“liner” part of the provided answer as acceptable. This acts as afurther clue for the participant that the prefix must be different.Other variants will be apparent to those skilled in the art.

The stock of epicts presented within interface 700 can come frommultiple sources, including artist submissions 720, and user submissions730. These are differentiated primarily on the basis of how the originof the image, rather than any significant technical basis, since bothcan be accessed from a database 324 (FIG. 3A). Nonetheless the processby which epicts come into existence can be used to augment theaccompanying metadata and presentation mode for the participant.

In a first case, artist submissions 721 preferably consist of imagescreated by original artists using one of the drawing tools mentionedabove. In such cases the original artwork 722 is selected, and thenprocessed by a routine 723 in the manner noted above for FIGS. 3A and3B. Thus the image is preferably presented all at once—in a staticmode—or using some form of timing, as in a replay mode based on using anactual artist rendering time. The latter could be accelerated or sloweddepending on other game parameters.

In other embodiments the epict could be presented in a degraded form (asnoted above) that gradually improves with time, based on a variablenumber of iterations, time, etc. For example the image could be givenincremental improvements every 10 seconds until a final image isreached. The participant's score could be weighted according to howquickly they decoded the image (i.e. what level of degradation).

In similar fashion user submissions 731, which may be basic JPEG images,can also be selected at 732 as a form of epict. This type of content isperhaps easier to contribute since many users have electronic cameras,tools for uploading images, online picture accounts (Shutterfly, Flickr,etc.) that can be tapped into for content. The images are preferablypre-treated (see discussion for FIGS. 3A and 3B above) to render theminto more artistic form, and/or to create different levels ofdegradation as noted above. Alternatively, in some embodiments it may bepossible to impart this type of visual appearance on the fly within theinterface, since sufficient time may be given between iterations topermit this degree of processing. In any event the images are presented,again, using one of the modes above, except of course that in suchinstances an original “artist” mode would not be possible in the case ofa photograph instead of a drawing. Nonetheless it is possible that anartistic rendering could be mimicked in some cases using additionalimage processing software.

For some applications it may be desirable to simply divide the imagefile into physical regions, and present different sets of pixels withinregions on a random basis. As an example, a set of N differentiterations could be used. At the first iteration, X % of the pixels arerevealed. At the second iteration, an additional set of Y % of thepixels for each region are revealed, and so on. This would give theimage the appearance of randomly filling in with time. Other variantsare of course possible and useable with the present invention.

As with the other embodiments above, the participant can also opt to usemusical hints during the presentation of the epict. In addition a hintboard 750 may also be displayed within the interface to give furtherclues to the participant. As noted earlier, the hint board may integrateadvertising as well, and the ad stock itself may form part of the visualclue, by way of images, text, music/audio, etc. Because theparticipants' focus may shift within the interface to pick up and detectsuch clue, the chances of an ad being perceived (and thus selectedeventually) by the user increase dramatically. While the time is runningfor the epict the hint board images could also be changed if desired. Inthis respect the stock could be rotated randomly, or based on someprogrammed logic. In an embodiment where the epict deciphering is timed,the user's selection of an ad within the hint board can be used as acontrol signal to stop the game clock so that the participant is notpenalized for viewing and interacting with an advertisement. Forapplications where timing is not used this would not be necessary ofcourse.

The advertisers can then also be given options for bidding on what timestheir ads are presented within the hint board during game play. Forexample the right to present a visual hint/ad during an earlier portionof the game could be auctioned/priced at a different price than theright to offer the same hint/ad at a second time later in the process.An end-of-epict time option can also be offered, to allow an advertiserto occupy the interface for a longer period at the end of the game.Other options can also be offered, such as the right to opt in or out ofan epict in which the participant was successful or not. All of thesefactors can be used to adjust an appropriate auction and compensationscheme.

The hint board ads could also be tailored based on a performance levelachieved by the participant, and thus a predicted mood of the user. Theuser's mood could also be determined with reference to prosodic elementsin a speech embodiment. For example a first type of ad might be shown ifthe user was successful in the current/prior epict, compared to a secondtype of ad if the user was unsuccessful. The invention can monitor theprogress and performance of the user to increase (or decrease) the levelof visual assistance through the hint board as needed to maintain anentertainment level for the participant. Most players will not want toplay a game that is too easy or too hard, and this balance can be struckin part by adjusting the types of supplemental hints given within theinterface. Again, too, the advertisers can participate and assist withsuch process by providing ad stock/associated epicts of various levelsof explicitness for a particular concept. The advertisers may also optto sponsor or present the musical hints and cues associated with theepict. The advertisers can then also be given options for bidding ondifferent levels of visual/audio hints, so that the right to offer afirst level of visual assistance is priced at a different price than theright to offer a second higher/lower level of assistance. Since it ismore likely a participant will have a positive association with a hintthat helps them solve the visual puzzle, this factor can be used toadjust an appropriate compensation scheme.

While some conventional online ads are presented in the form of a game(e.g., they require the user to interact with them, such as using amouse) it can be seen that the hint board 750 instead behaves as a formof additional artist/participant for the game the user is engaged in.Those skilled in the art will appreciate that this feature may be usedadvantageously in other game environments in which it is desirable toimpart clues/cues to a game player using an interactive ad.

While not shown explicitly the game can of course use and exploitdemographic and other profile/behavioral data collected for participantsto enhance game play. The epict database 324 of artist and authorcontributions can be made available to news aggregators, search engines,etc., so that relevant content is presented to web surfers looking forpertinent information on particular concepts.

As shown in FIG. 8, in some embodiments a search engine, blog, newsfeedor news site 800 may offer accents or other adornments of a page basedon epicts contributed by an artist community. For example, a Google newsstory about a person/place may be coupled with one or more artistcaricatures of such person/place.

Similarly, in a search engine page 810, a person looking for the Towerof London may be shown an epict 815 for such as part of the searchresults page. As with the above embodiments, the epict 815 (preferablycompressed to thumbnail size) may be combined with an ad 820 to form anew ad 825, so that the attractiveness of ad stock can be increased fora general searcher using a search engine, and the chances of aclick-through increased by virtue of the additional visual aesthetic.This mechanism further allows artists to tap into and benefit fromadvertising dollars as they can be rewarded for their success increating incremental benefits over conventional text only ads.

Search engine operators such as Google can thus also maintain a stock ofepicts/artists that can be bid upon with a conventional auction engine830 by advertisers 835, much in the same way keywords are bid upon in anAdwords campaign. The performance of individual epicts in clicks andconversions can be tracked as with any other keyword. This again wouldallow for a more efficient marketplace to acknowledge and recognizesuccessful advertising copy contributed by artists.

The same advertising and epict coupling can be used of course in anAdsense campaign as well, so that members of an advertising network canhave pages 810 supplied by a combination of text and images proven to beattractive to web surfers. Since Adsense campaigns are based on thecontent of the webpage 810 in question, a similar matching scheme couldbe done here. If desired, the ad and epict auctions could be de-coupled.That is, both would be evaluated separately for inclusion on a page, sothat one matching engine would determine if the advertiser's ad isappropriate for the page, while a separate pictorial matching enginecould use a separate algorithm to match metadata for the epict and thusselect it that way. For example a site devoted to fishing may be servedwith Adsense ads on fishing supplies, while the epict for the page maybe in the form of a fishing boat, a hook, a boy fishing off a pier, etc.Other examples will be apparent to those skilled in the art.

Consequently epicts can be the subject of auctions based on keywords inqueries, by which an advertiser first wins the right to present withinthe page, and then presents an epict along with the ad. In addition tothis the advertiser may separately have to bid on the right to use aparticular epict with an ad, so this could be part of a separate auctionthat is conducted after the first ad auction. Alternatively epicts canbe presented based on the content of the pages, the search results, orthe ads.

Other content sites and programs could access the epict database inquestion as well depending on a desired visual effect. Some musicproviders, such as Itunes, may offer accompanying epicts for theirsongs/albums for example. In auction sites, members who do not otherwisehave visual images for an offering can elect to use an epict instead atnominal cost. Members of social networking sites may elect to adorntheir profile pages with static or rotating epicts devoted to particularset themes, or dynamically based on topics of discussion presentedwithin a discussion wall. The invention can thus mimic the behavior ofconventional ad-serving systems which present ads based on the contentof a web page. In other words, the content of a web page can be analyzedto determine one or more related topics which are then matched to one ormore topics associated with image in a database of images/topics.

All of the above schemes could be implemented under a royalty schemethat rewards the artists/authors in question.

It will be understood by those skilled in the art that the above aremerely examples and that countless variations on the above can beimplemented in accordance with the present teachings. A number of otherconventional structures/steps that would be included in a commercialapplication have been omitted, as well, to better emphasize the presentteachings.

It will be apparent to those skilled in the art that the modules of thepresent invention, including those illustrated in the figures can beimplemented using any one of many known programming languages suitablefor creating applications that can run on large scale computing systems,including servers connected to a network (such as the Internet). Thedetails of the specific implementation of the present invention willvary depending on the programming language(s) used to embody the aboveprinciples, and are not material to an understanding of the presentinvention. Furthermore, in some instances, a portion of the hardware andsoftware will be contained locally to a member's computing system, whichcan include a portable machine or a computing machine at the userspremises, such as a personal computer, a PDA, digital video recorder,receiver, etc.

Furthermore it will be apparent to those skilled in the art that this isnot the entire set of software modules that can be used, or anexhaustive list of all operations executed by such modules. It isexpected, in fact, that other features will be added by system operatorsin accordance with customer preferences and/or system performancerequirements. Furthermore, while not explicitly shown or describedherein, the details of the various software routines, executable code,etc., required to effectuate the functionality discussed above in suchmodules are not material to the present invention, and may beimplemented in any number of ways known to those skilled in the art.Such code, routines, etc. may be stored in any number of forms ofmachine readable media. The above descriptions are intended as merelyillustrative embodiments of the proposed inventions. It is understoodthat the protection afforded the present invention also comprehends andextends to embodiments different from those above, but which fall withinthe scope of the present claims.

What is claimed is:
 1. A method of testing recognition of images for aCompletely Automatic Public Turing Test To Tell Humans And ComputersApart (CAPTCHA) system comprising: a. automatically electing anelectronic image for a participant with a computing system, wherein saidelectronic image comprises a set of imagery data other than words, andwherein said electronic image is configured such that a subset of saidset of imagery data for said electronic image can be made perceptible ina first image state; b. associating said electronic image with one ormore concepts; c. presenting said electronic image in said first imagestate and progressively revealing information over a first time periodwithin an interface for said participant using said computing system; d.automatically processing responses from the participant with thecomputing system to correlate an accuracy of guesses from saidparticipant for said one or more concepts associated with saidelectronic image; and e. calculating a percentage of participants ableto decode and accurately guess said one or more concepts within apredetermined time.
 2. The method of claim 1 wherein said progressivelyrevealing information comprises presenting said electronic image atdifferent time intervals with differing levels of resolution, noiseand/or pixelation.
 3. The method of claim 1 further including a step:using said electronic image within a CAPTCHA system for granting accessto resources of a second computing system.
 4. The method of claim 3wherein said second computing system is associated with a portableelectronics device.
 5. A method of providing a visual CompletelyAutomatic Public Turing Test To Tell Humans And Computers Apart(CAPTCHA) challenge comprising: a. automatically electing an electronicimage for a participant with a computing system, wherein said electronicimage comprises a set of imagery data other than words and wherein saidelectronic image is configured such that a subset of said imagery datafor said electronic image can be made perceptible in a first imagestate; b. associating said electronic image with one or more concepts;c. progressively revealing information in said electronic image over afirst time period within an interface for said participant using saidcomputing system; d. automatically processing responses from theparticipant with the computing system to detect if a guess from saidparticipant for said one or more concepts associated with saidelectronic image meets a required threshold; and e. determining apercentage of participants with guesses meeting the required thresholdwithin a predetermined time.
 6. The method of claim 5, wherein saidresponses are received in audible form and processed by a speechrecognition device adapted to recognize human voices.
 7. The method ofclaim 5 wherein the CAPTCHA challenge is embodied in a computer readableform and implemented as a routine executing on a portable computingdevice which also has motion and/or orientation sensors.
 8. The methodof claim 7 wherein the visual CAPTCHA challenge is combined with aphysical CAPTCHA challenge requiring the user to manipulate the portablecomputing device in a prescribed manner.
 9. The method of claim 8wherein said physical CAPTCHA challenge is used to interact withelements of said electronic image and/or other objects presented in saidinterface.
 10. A method of testing recognition of images for aCompletely Automatic Public Turing Test To Tell Humans And ComputersApart CAPTCHA system comprising: a. automatically electing an electronicimage for a participant with a computing system, wherein said electronicimage comprises a set of imagery data other than words, and wherein saidelectronic image is presentable with differing amounts of data,including a first image state in which only a first portion of the imageinformation therein is perceptible; b. associating said electronic imagewith one or more concepts; c. presenting said electronic image in saidfirst image state and progressively revealing additional information insaid electronic image over a first time period within an interface forsaid participant using said computing system; d. automaticallyprocessing responses from the participant with the computing system tocorrelate an accuracy of guesses from said participant for said one ormore concepts associated with said electronic image; and e. calculatinga percentage of participants able to decode and accurately guess saidone or more concepts within a predetermined time.
 11. The method ofclaim 10 wherein said progressively revealing additional informationcomprises presenting said electronic image at different time intervalswith differing levels of resolution, noise and/or pixelation.
 12. Themethod of claim 10 wherein said automatically processing responsesoccurs during said presenting said electronic image and saidprogressively revealing additional information.
 13. The method of claim10 further including a step: using said electronic image within aCAPTCHA system for granting access to resources of a second computingsystem.
 14. The method of claim 13 wherein said second computing systemis associated with a portable electronics device.